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ABSTRACT 

This collection of papers represents the 
developmental research as veil as t v ^ thrust of the Regional 
Laboratory's {UMREL) program. UMREL has been developing behaviorally 
engineered educational environments through a cross-disciplinary 
effort in education and the behavioral sciences. The program began 
with the establishment of demonstration contingency-managed 
classrooms for use as training and research sites. These classrooms 
are complete, self-contained behaviorally engineered units. 
Instruction is individualized and programmed; the teaching 
techniques, curriculum materials, and physical-social environment are 
designed to facilitate maximum academic performance. Basedon the 
data provided by these classrooms, UMREL is developing a 
multi-faceted education eco-system. This system includes; specific 
behavioral objectives, preservice and inservice management technique 
training programs, and an educational resources center. In addition, 
a mechanical and/or automated computer based instructional management 
and analysis system contains data on: 1) curriculum material related 
instructional objectives; 2) the effects 
behavior for use in formulating specific 
administrative activites. (SBE) 



of various 
objectives; 



procedures on 
and, 3) school 



An Overview of UMREL's Program 



The Upper Midwest Regions] Educational 
Laboratory b developing txhiviofilly engineered 
educational environments through a cross disci- 
plinary effort In education and the behavioral 
sciences. The outcome of this program will be 
scientifically sound educational environments 
specifically designed to maximire student aca- 
demic and social performance. 

UMREL's program combines experience in 
education with the techniques of behavioral 
analysis, a scientific discipline based on two 
fundamental premises: 1) that any behavior, 

comprising observable and recordable events, 
can be me*Air*d; and 2) that the relationship 
between a particular behavioral event and the 
surrounding environmental conditions are law- 
ful, orderly, and predictable. 

Four main classes of variables determine the 
characteristics, Including the probability of oc* 
cunt nee, of any behavioral event. These are: 
I) the environmental conditions which precede 
and accompany the behavior; 2) the special 
properties of the response-topographical, phyt* 
iotogkal, etc.; 3) the contingencies whkh relate 
w onset to their Immediate consequences; and 
4) the environmental consequences themselves 
(Daley and Wolff, 1969). A complete behavioral 
management program employs systematic man- 
ipulation of these independent variables to 
rearrange response probabilities and facilitate 
occurrence of desired behavior. 

Behavioral Anatysh In Education 

Any teacher function as a behavioral engi- 
neer when he shapes hb students' behavior 
by establishing a stimului environment condu- 
cive to academic performance and reinforcing 
that performance when it occurs. Systematic 
behavioral aftj*y*b in educational environments 
simply replaces the teacher's intuition with 
the methods of empirical study used by any 



* 

other sciential; controlled observations of 
events and their surrounding environments. Sci- 
entific evidence is used to design procedures 
which have t demonstrable effect on the stu- 
dent’s behavioral repertoire. 

The development of techniques employing 
frequently oevuring classroom behavior as direct 
reinforcement for appropriate academic perform- 
ance is particularly significant to classroom 
management. 

Myor contributions in this area have evolved 
from the work of David Premack, who developed 
a reinforcement concept called the Differential 
Probability Principle whkh states: "...for any 
pair of responses, the more probable one wdl 
reinforce the less probable one" (Premack, 
196$, p. 132). An Important corollary to this 
principle is the Indifference Principle, whkh 
states that the reinforcement value of an event 
b independent of the parameters producing 
response probability, l.e., any behavior can be 
used as a reinforces of any other lower proba- 
bility behavior. 

Using Pit mack’s principles, only each student’s 
most frequently emitted responses must be 
identified for use as re in forcers, and reinforcing 
events may be easily arranged as consequences 
for behavior. Any mechanical dependency on 
candy cr trinkets as reinforces, h eliminated. 

With techniques based on Premack's princi- 
ples (known o as contingency management 
techniques), Lloyd Homme effectively modified 
the behavior of nursery school children <1963), 
adolescents ( 1 964)prt-school non English-speak- 
ing Indian children (1963), and young non- 
talking retarded chPdrtn (1963). He abc suc- 
cessfully applied contingency management to 
achooHike tasks (1964, 196$) and problem 
behavior (1963, 196$). 

Daley. Holt, and Vajanasoontoen (1966) Inves- 
tigated a technique in which high-probability 



responses were pictured in a menu (Addison 
and Homme, 1966). Several ways of managing 
contingencies of high and low probability re- 
sponse classes, and strengthening or developing 
behavior important to the academic or accul- 
turation processes of trainable mentally re- 
tarded were examined. 

Following this study. Friar (1969) showed 
that it is possible to engineer increases and 
decreases in both academic and no.vacademk 
response Hasses with standard materials tn 
another experiment with moderately retarded 
children, Daley and Holt (1969) showed that 
the menu of activities could serve ns a device for 
fading low probability task behavior into high 
probability reinforcing behavior, thus greatly 
enlarging the number of reinforcement events 
whkh the eductor can use In his Instructional 
management programs. 

Laboratory Program 

UMREL's work on the developncnt of bc- 
havionfly engineered educational ervironments 
began with the establishment of demonstration 
contingency-managed classrooms for use as train- 
ing and research sites. These classrcoms, which 
were designed to make use of eliding facil- 
ities in a typical schoolroom, ara complete, 
self-contained behaWoraHy ergineered units. In- 
struction is individualized, and IV tracing 
techniques, curriculum materials, and physical- 
social environment are designed (o facilitate 
maximum academic performance. 

On the base provided by these drminstration 
classrooms, the Laboratory is developing a 
multi-faceted behaviorally engineered and en- 
vironmentally oriented educational system. A 
Finished system, suitable for adoption by school 
districts across the country, will litre: 

a) specific behavioral objectives bared on 
useful m loathe criteria for ill com- 
ponents of the instrvcttonal system; 

b) educational pro- and bi-service train!?* 
tn management techniques and pupil 
data based Instructional program; 

s) a curriculum objectives bank available 
to all participants; 



d) an educational resources center, me- 
chanical and/or automated computer 
based Instructional management, with 
accompanying reorganized staffing of 
professional educators, etc. 

The bask dependent variable studied in the 
Laboratory's developmental work is the stu- 
dent's academk performance. All the other 
variables In the learning environment -class and 
teacher behavior, reinforcement procedures, cur- 
riculum materials, organizational characteristics 
of the school, and even the political and social 
conditions In the community-are Investigated 
to reveal their relationship to student perfor- 
mance. Changes In the variables art evaluated 
by the concrete gains or changes in student 
performance whkh result. 

The research findings contribute to Improved 
design of instructional practices, curriculum 
materials, and the educational environmental a 
whole, as well as to the development and 
validation of a new training program for school 
personnel, thus improving the adoption process. 

To correlate all the information generated by 
this program and to maintain the characteristics 
of ihe engineered environments, the Laboratory 
is developing an ecological maintemnee system 
whkh will provide principally procedural In- 
formation relevant to several types of environ- 
ments and a pupil-based source data bank useful 
to practitioners in the Field. 

One division of this Informal ion/malntenance 
system Includes a bank of instructional objec- 
tives related to currently available curricular 
materials with objectives collected for each 
subject area. 

A second division contains actuarial data 
concerning the effects of various procedures on 
behavior. Thb information b stored In the 
form: 'Often sets of conditions, X; with Y 
rates of response; l procedures will produce 
these quantitative consequences on Y.” Se- 
lected statistical analyses are made from thb 
bank, and practicing educators and researchers 
may query the b nk about the most effective 
and efficient methods to reach specific educa- 
tional objectives. 
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A third division in the system will store pro- 
cedural and data base information on school 
administrative activities like cost accounting 
methods, record-keeping operations and mate- 
rial Inventory and allocation. 

In addition to developmental work within 
UMREL, cooperative selatlonships have been 
established with state universities, colleges, state 
departments of education, local school systems, 
and private industry to support the work the 
Laboratory has undertaken. 

The Laboratory provides the institutional 
and skill/knowledge base for program activ- 
ities. Outside expertise is brought In when 
needed to augment the Laboratory staff. 
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This collodion of papers represents the development;! resca»ch as well as the 
thrust of UMREL's program. Our primary objective* the design and implemen- 
tation of behaviorally engineered environments, requires the investigation of each 
component in our educational cco-system. As such, these papers are organized 
around five basic areas of research: I) behavioral objectives; 2) programmed 

instruction; 3) behaviorally engineered classrooms; 4) educational ecologies and; 
5) systems analysis and measurement. 
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A Curriculum for Every Child 



Lanny E, Morreau 

Because effective educational methods will 
always result in the modification of student 
behavior, the most important criteria for eval- 
uating teaching strategics is change in the stu- 
dent's behavior. In assessing the quality of in- 
struction. in tenns of both methodology and 
materials, the measurement index must be based 
on the learner s terminal behavior. 

The precision necessary for evaluation of m 
struct ion al outcomes is provided by bt lunfonilfy 
written instructional objectives which include: 

1. the specification of “the learner" as differ- 
entiated from a class or group of learners. 

2. a specific measurable response which the 
learner will emit* 

V a delineation of the stimulus conditions 
under which the response will occur, 

4. a specific statement on the frequency, du- 
ration, or quality of the response, 

5. a criterion level at which the performance 
w ill be considered successful. 

The bchavioially written instructional objec- 
tive not only provides a measurement index for 
the evaluation of pqpil progress, but it also 
senes as a guide for teacher decision-making. 
Ctiven a set of complete. sequentially arranged 
(omitting nc pre-current skills necessary to the 
terminal behavior) irMUKtiorul objectives, the 
teacher has all the Information necessary for 
planning and designing procedures, materials, 
and measures. 

l ew complete iftjtrucf tonal objectives exist 
for most subject matter areas, and for subjects 
like social studies and wiener, teachers have 
cxmsistcntfy been left on their own to deveJop 
the necessary “unite" 

To help teachers with this problem. UMRfcL 
has developed a guide for planning indrviduab 
i?ed lessons The guide first directs the teacher 
to narrowly define each topic, (see model of 



Individualized Lesson Formal, fig. 1.1. and then 
divide the topic into its major concepts. These 
concepts are numbered, and then restated as 
educational objectives -operational descriptions 
of a general class of student behavior which w ill 
represent subject-matter skill/knowledge. Ba>d 
on the educational objective, the teacher on 
write and evaluate her instructional objectives. 

The UMRfcL guid; provides for abbreviated 
objectives. Action can usually be specified as a 
single word, the measure with a number and a 
noun, the conditions with a short phrase, and 
the criteria with a percentage. Instructional 
objectives written in this format can be easily 
evaluated against the educational objective 
which has been paired with the concept on the 
guide itself: Does the objective, if met. indicate 
the subject matter expertise hicli is indicated 
in the educational objective? II not. how can it 
be mod i fie J? 

After preparing a sequence of i n strut fional 
objectives for each educational objective, the 
teacher b directed to evaluate the objectives in* 
tcrnall> . Are they in logical sequence? Have any 
necessary for continued progress through the pro- 
gram been omitted? Have difficult dKiiminj- 
tions or generalization^ been dealt with? Are any 
objectives unnecessarily redundant, is each rele- 
vant to the student's terminal behavior’ 

The teacher wiites and evaluates the complete 
set of instiuvtional objev lives for each major 
concept using these criterion questions. She 
then designs her lesson plan using Ihcwr objec- 
tives as guides tor each olj.'ctrve the teacher 
must design or select procedures and activities 
which will Dad to the terminal behavior sgsyf 
Ood in the objective. She can esaluate her 
oecisjons by answering three questions about 
each procedure or activity: (I) Is this preve- 
durt /activity relevant to the terminal response? 
(2) After completing this proccdure/Ktrvit). 

$ 



wiii tnC siuri nt emit the specified response? 
(3) Does the procedure/aclivity contain generals 
nations leading to the learners emitting the re- 
sponse under the conditions specified? 

Having correlated specific activities and proce- 
dures to t!> rminal response of the learner, the 
teacher identifies the materials needed by listing 
associated materials under each procedure/activ- 
ity. The UMRKL guide directs the teacher to ask 
these questions: What specific materials are need- 
ed to match this procedure /activity? Does this 
material, (eg., student desk maps, programed 
science units) lead to the terminal response 
specified In the objective? Is this material avail- 
able? If so, from where? If not, what can I 
substitute? 

As previously noted, the teacher must use the 
learner’s response as the measurement index 
when evaluating her methodology and her mate- 
rials. The content and structure of the criterion 
check which she prepares must be specifically 
related to the instructional objective. She 
should ask: Is the response emitted on the 



criteria<hcck the same response as specified in 
the objective? Is the structure of the criteria- 
check items consistent with the conditions stat- 
ed in the objective? Is the quantity, duration, or 
quality of the response required consistent with 
»he measure? Will the meeting of the specified 
criteria on these items indicate the subject mat- 
ter repertoire indicated in the educational objec- 
tive? 

The final section of the guide provides the 
teacher with an on-going evaluation procedure. 
If students fail to meet the objective, she can 
note the following information: To what degree 
did the learner fail to meet criterion? Were the 
specific procedures, activities, and materials used 
not tied precisely enough to the objectives (re- 
assess)? If not, what other procedures, activities, 
or materials can be implemented to correct for 
this? 

Using this guide, in conjunction with her con- 
tinuous reevaluation, the teacher is able to for- 
mulate individualized lesson plans in a precise, 
functional manner. 



Figure 1: MODEL OF INDIVIDUALIZED LESSON FORMAT 
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Major Concept 
Objective No. 
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1. Action: _ 

Measure: _ _ _ . ^ 

Condition : _ 

Criteria: 

2. Action: 
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3 Action: 
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Provedure and Activity: 



Materials Needed: 



Student — Evaluation Procedure 



Teacher Evaluation of Lesson: 
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Full Service Banking of Objectives 



Robert A. Wininger and Robert G, Publicover 

A system was needed for teachers in UMREL's 
beliavioralty engineered classrooms so they could 
1) clearly define each response and its specific 
properties, and 2) select specific stimulus events 
to which the learner could respond. In response 
to this need UMREL developed a storage and re- 
trieval system (bank) for sequentially arranged 
instructional objectives. 

Our banking system* which relics in part on 
the work of people like Robert Gagne, Robcit 
Glaser, Robert Mager, and Janies Popham, has 
four major characteristics: 1) all objectives are 
sequentially arranged, 2) all objectives are com- 
plete (including student-aclioivmeasur '-condi- 
tion-criteria), 3) each objective contains instruc- 
tions for teacher use of the objective itself* and 
4) specific units of curriculum material are tied 
to each objective. 

Sequencing Objectives 

The sequential arrangement of objectives senes 
severu 1 major functions: l) it assures that requir- 
ed generalization will occur, 2) it directs the 
pupil toward increasingly complex discrimina- 
tion, 3) it prevents the omission of prerequisite 
skids for meeting any terminal objective, and 
4) it enables the teacher to place students pre- 
cisely within a body of objectives. These func- 
tions are assured by including in the system a 
curriculum area identifier (such as “reading"); 
identification of the major and sub-concepts, 
the content level or grade levels of the materials, 
ami the identification number for each objec- 
tive. These filing categorizations enable the- 
teacher to find appropriate objectives manually, 
but the system is also compatible with an auto- 
mated storage/retrieval/referencing system. 

Complete Objectives 

The complete objective gives the teacher a pre- 
cise statement of what is expected from the stu- 



dent in measurable, behavioral terms. A complete 
instructional objective by our definition contains 
five major components: the student, an action, 
the conditions, the measure, and the criteria, 
The learner is specifically referred to within the 
objective sequence to differentiate these objec- 
tives from the traditional objective designed for 
assuring “class" or “group" outcomes. The con- 
dition is designed to communicate the parameter 
within which the student will be working. The 
action, expressed in precise verb forms, provides 
for the measurement of pupil responses The 
measure states the numerical quality, quantity 
or duration of responding. The criteria estab- 
lishes the level at which the student must be able 
to respond in order to proceed within the se- 
quence of objectives. 

Teacher Instructions 

These instructions provide teachers with: 
1) procedures for the evaluation of student per- 
formance, 2) procedures for introducing instruc- 
tional materials, and 3) sample problems from 
those materials. The evaluative procedure pro- 
vides answers to such questions as, “Should I use 
a curriculum-embedded test for this objective?" 
or “Should I test orally?" The instructions for 
teachers communicates special requirements for 
the teacher as she prepares to use a specific 
objective. 

Curriculum References 

The curriculum references provide the teacher 
with materials designed to meet a specific associ- 
ated objective. Several different sets of curricu- 
lum materials are given for each objective to pro- 
vide data for the continuous testing and modifi- 
cation of curriculum materials. 

Each of these characteristics is essential when 
structuring a banking system for instructional 
objectives. Sets of complete sequentially arrang- 
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ed instructional objectives must be functionally 
tied to the performance of the individual The 
teacher must have a precise and complete state- 
ment of the objective. Suggestions for materials 
must be available, though the system must be 
flexible enough to allow the teacher to introduce. 



variations. The format should make sequencing 
dear and furnishes an automatic check of perfor- 
mance. And, for our system, the format is com- 
patible with computer tabulation and manipula- 
tion of progress data. UMREL has developed 
such a system. 
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English Objectives: Non Standard Dialects 



John C. Maxwell, Karen J, Hess and Barbara K, Long 



The control of standard English by speakers in 
appropriate contexts has been a longstanding 
objective of elementary and secondary instruc- 
tion, but a host of apparently irrelevant teacher 
behaviors has arisen in attempts to meet this 
objective. 

In approaching this major instructional prob- 
lem, the Laboratory first sought to define the 
relevant behaviors of teachers which would per- 
mit them to individualize instruction (and there- 
fore focus instruction) for the improved control 
of rcgionally-standard English among students. 

After a thorough study of the literature on 
the subject, the following target behaviors were 
identified. At the end of the UMREL training 
program, teachers would be able to: 

1. Demonstrate through written tests a mini- 
mal understanding of ten basic concepts about 
dialects— their origins, their nature, and their sig- 
nificance to their speakers. 

2. Secure, on utidio tape, speech streams of a 
specified (i.e,. careful) type of a sufficient dura- 
tion and technical quality to provide a means for 
detailed analysis. 

3. Write a broad phonetic transcription of the 
speech streams secured (or, more accurately, 
those subparts of such speech streams which arc 
nonstandard for the speaker's region). 

4. Classify the nonstandard features accord- 
ing to broad categories and according to specific 
sub-categories. 

5. Apply data on linguistic and social signifi- 
cance of nonstandard features, and data on the 



frequency of the student’s use of those features 
to arrive at a critical and individualized curricu- 
lum on usage for the student. 

6. Select appropriate teaching materials which 
can be used on an individual basis, and “bank” 
reference cards pertaining to those materials so 
they can be easily retrieved for application to 
individuals. 

White the training program io bring teachers 
to criterion level in these behaviors is being de- 
veloped further, work lias begun in creating a 
bank of behavioral objectives in usage and dia- 
lect, stated for students. At the present time, 
curriculum objectives are stated as topics (e.g,, 
“verb agreement”) or undifferentiated negative 
statements (c.g,. "does not use is with singular 
subjects). In rewrite, the objectives will be stat- 
ed affirmatively and will specify the contexts in 
which the behavior should occur. 

Further work will be done in the Laboratory 
to secure and catalog instructional materials per- 
tinent to the bank of instructional objectives on 
usage. These materials can be then matched 
with the objectives and applied by the teacher 
to those students shown by the teacher's diag- 
noses to need wor!. nn the behavior. 

When application of the student training sys- 
tem is being conducted, it is quite probable that 
the training program for teachers will be modi- 
fied. Thus, the hypothesized set of behaviors 
indicated for teachers will be modified according 
to their known importance in changing the 
behavior of students. 



Teachers for Tomorrow 



Dennis L, Jacobsen 

Southwest Minnesota Slate College in Marshall, 
Minnesota, has recently begun a leaclier-educa- 
lion program based on many of the educational 
concepts UMRLL is developing. The Labora- 
lory is working closely with the college in this 
program, which is designed !o prepare teachers 
to implement an individualized curriculum based 
on instructional objectives. Teachers arc being 
trained in the skills of educational behavior man- 
agement-contingency management, principles of 
behavior objectives, behavioral analysis of learn- 
ing problems, etc. The Laboratory' has provided 
Southwest State with directions in the applica- 
tion of instructional objective principles, and 
format, design, and development guidelines for 
the instructional objective materials. 

The Southwest State College project is quite 
important to the long-term success of UMREL’s 
developmental program. While in-service teacher 
training given in Laboratory workshops and sem- 
inars is satisfactory for present developmental 



work, these small-group training programs would 
not be feasible for training the large number of 
teachers necessary for widespread implementa- 
tion of UMRLL designs. By providing valuable 
information on the costs and procedures neces- 
sary for pre-service teacher training, the South- 
west State effort will help in planning for even- 
tual initiation of UMRLL oriented teacher edu- 
cation programs at other teaching institutions. 

In addition to these long-range benefits. South- 
west State also provides important feedback data 
on the use of UMRLL products. An UMRLL 
Contingency Management training module will 
soon he used for teaching application of CM 
principles to classroom situations, and the highly- 
developed Dialects and Dialect Learning self-in- 
structional module will be included in South- 
west’s project. In the future an UMRLL-devel- 
oped precision teaching unit may also be used. 

In all these areas, the UMREL-Southwest State 
College liaison is producing substantial payoffs 
for both institutions. 
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Planning by Objectives: Workshops that Work 



Craig R. Olson and Rosemary L. Christensen 

Workshops seldom change the behavior of 
those who attend them, usually because work- 
shop organizers fail to specify the outcomes 
they desire for the participants. 

The Laboratory staff attacked this problem 
during a recent training session conducted for 
workshop leaders from the National Indian Edu- 
cation Conference. The workshop leaders, each 
scheduled to lead 90-niiiuite sessions during the 
week of the Indian Education Conference, were 
1 rained primarily in 1 he techniques of planning 
by objectives. 

During the EMREL training, workshop lead* 
ers wrote objectives not only for workshop par- 
ticipants, but also for themselves as workshop 
leaders, As an aid in acquiring the skills requir- 
ed for writing the objectives, before the training 
session each workshop leader received a packet 
of materials containing a rationale for using ob- 
jectives. a guideline for preparing objectives, ex- 
amples of properly written objectives, and a list 
of objectives which could be used in the work- 
shops. 

The training session itself was devoted to re- 
viewing procedures for writing objectives and to 
actually writing objectives for each workshop. 

The objectives prepared by the leaders did not 
meet all the technical requirements, but they 
were usually reasonable approximations of what 
wus desired; any problems encountered in using 
the planning by objectives approach in conduct- 
ing the workshops was unrelated to the leaders' 
objective writing techniques. 

During the training session several leaders did 
not feel sufficiently competent to decide by 
themselves which objectives w ere essential. They 
thought it was presum pi nous to establish objec- 
tives without factual information about existing 
skills and knowledge of the participants. In this 
situation, the only solution seemed to be for 



workshop leaders, as experts in Indian education, 
to make the best estimate they could of capa- 
bilities and needs of individuals attending their 
workshops. A better, though more difficult solu- 
tion would have been to obi a in from partici- 
pants, through a questionnaire or survey, an in- 
dication of what they wanted to accomplish by 
attending a particular workshop. 

A second problem was several leaders’ fear of 
preventing contributions from participants by 
structuring the workshop 100 tightly. They 
thought that if the entire time was spent accom- 
plishing objectives that they alone had defined, 
they would effectively prevent any spontaneous 
contributions from participants. This limitation 
is not as detrimental or as difficult to overcome 
as it first appears. Planning by objectives doesn't 
mean that workshop participants remain passive. 
On the contrary, this approach specifics only 
that persons participate in a deliberate, planned 
manner so that desired outcomes can be accom- 
plished. 

One problem encountered during the actual 
workshop sessions involves the control of par- 
ticipant behavior. The workshop leader has no 
really effective means of controlling every type 
of behavior during the session, in one w orkshop, 
an individual who was unwilling to abide by ac- 
cepted conventions and procedures was able to 
disrupt the planned activity of the entire group. 
If a planning by objectives approach is to suc- 
ceed, some way of insuring the cooperation of 
all participants must be developed. 

In general, workshop leaders responded favor- 
ably to the training session. In assessing the 
session after they had completed their work- 
shops, many leaders felt that the largest dividend 
resulted from being required to think in behav- 
ioral terms about what they wanted participants 
to accomplish. Many leaders also felt that this 
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approach made organizing their workshops easier 
and more efficient, and several participants re- 
marked that having a list of objectives to be ac- 
complished in each workshop they attended 
made the session more productive for them. 

Planning workshops by using specific objec- 
tives presents no problems that cannot be suc- 
cessfully solved or mitigated. The question re- 



mains, however, whether benefits gained from 
approach are worth the time, effort and cost ex- 
pended. As in all cases of programed instruc- 
tion, some easily learned strategies will have to 
be developed for assisting the workshop partici- 
pant in generating his own objectives. Once this 
is done, it wiil then be possible to access the rela- 
tive value of this approach. 



Behavioral Management 
through Programed Instruction 



Marvin F, Daley and Lanny E. Morreau 

Techniques and principles of behavior man- 
agement are rapidly being extended inlo the 
field of education. One of these principles 
which is particularly applicable to classroom 
management, states that any behavior, at the 
time it is of higher probability, can be used to 
reinforce a lower probability behavior. Using 
this principle, a teacher car) arrange a class- 
room environment so a student’s access to high 
probability activities (reinforcing events) is con- 
tingent upon the completion of low probability 
activities (task behaviors). Through this man- 
agement of contingencies a teacher can increase 
the emission of selected task behaviors. 

At the time that this research was initiated, 
there was no single source where teachers or 
teacher candidates could gain a functional knowl- 
edge of the principles and techniques involved 
in the management of contingencies. A proce- 
dure with the following characteristics was need- 
ed for the training of teachers: I) it would lead 
to the specified terminal behaviors on the part 
of the teacher; 2) it would be cost-effective; and 

3) mild be easily disseminated. 

st step in the development of a teacher 
r ir.rn* rogram was to isolate the basic prin- 
ciples 0 / mi n ccy management. The criteria 
for selection * , based on responses to two 
questions: 1) Which principles does the teacher 
have to know in order to successfully manage 
contingencies? 2) To what degree is it necessary 
for the teacher to have a pedagogical knowledge 
of the data base underlying these principles? A 
decision was made to design a program using a 
series of application rules with minimal empha- 
sis on the theoretical data on which these rules 
were based. The decision was also made to 
structure these principles in a programed formal. 
This decision satisfied our cost-effectiveness and 
ease of dissemination requirements, while provid- 
ing an empirical procedure for the design of a 
training program, 

A criticality index was established for the 
evaluation of each principle in terms of its behav- 



ioral significance to management behaviors. The 
principles were then grouped in terms of 1) the 
generalizations which must occur as the student 
proceeds towards a higher degree of simulation 
(classroom practice) and 2) the interaction of 
any of these rules or applications which might 
inhibit or promote continual progress towards 
the terminal response. Based upon these gen- 
eralizations and discriminations, the principles 
were systematically arranged 1o facilitate the 
students’ retention of Die information. 

This deductive design was adapted for use in 
programing the sequentially arranged principles: 

1) Presentation of a principle; 

2) Presentation of an example of the principle ; 

3) Presentation of a question pertaining to the 
principle with several alternative responses; 

4) Presentation of the correct answers to the 
question with a brief discussion: 

5) Presentation of a problem related to the 
principle; and 

6) Presentation of criteria by which the stu- 
dents could evaluate his responses to the prob- 
lem. 

The teacher training program developed around 
this model included: 1) a programed text; 

2) videotaped samples of student behavior for 
practice in applying the selected contingency 
management principles; and 3) a series of pro- 
gress checks with which the student could eval- 
uate his performance in the program. 

The criterion behavior on the part of the 
learner, the teacher or the teacher-candidate, 
was specified as follows: 1) Upon completion of 
the program, the student would correctly write 
the selected principles of contingency manage- 
ment when presented with 20 open-ended ques- 
tions pertaining to these principles; 2) Given a 
videotaped sample of pupil behavior, the stu- 
dent would write a behavioral prescription 
which would include a specific low probability 
behavior, 3 specific high probability behavior, 
and the arrangement of a response contingency. 



The ultimate test of any program rests in the 
measurable change in the behavior of the learner. 
In this case, (lie primary question was whether a 
teacher could successfully establish and main- 
tain a behaviorally engineered classroom after 
having completed the program. Specifically, she 
should be able to: 

a) Select, write, or modify instructional ob- 
jectives for each area of the curriculum. 

b) Select, measure, and re cor 1 specific stu- 
dent respons 

c) Extrapolate data from (he recording sheet 
to a graph and interpret behavioral changes, 

d) Specify present level of task performance 
and increase on a systematic basis. 

e) Establish performance criteria for each area 
of task behavior. 

0 Select high probability behaviors for an 
individual student based upon her observation 
and measurement of his behavior. 



g) Design and structure a classroom environ- 
ment to include three distinct areas: TASK 

AREA, PROGRESS CHECK POINT, and RE 
AREA. 

h) Arrange a contract including specific Rein- 
forcing Events which will be piesented contin- 
gent upon specified task completion. 

The composite program was first tested in 
summer 1968 with a population of 22 Special 
Education teachers, then modified on the basis 
of teacher feedback during the training session, 
and on the basis of subsequent change in the 
teachers* behavior in the classrooms. Other test- 
ing populations have included primary and sec- 
ondary teachers in both rural and urban class- 
rooms. 

The change in teacher behavior represented 
by their classroom management skills supports 
the premise that cost-effective programs can be 
developed for teacher training through the use 
of programed instructional strategies. 
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Pre-Schoolers Quickly Learn to "Tell Time" 



Mary E. Fullmer and Robert G. Packard 

A design which focuses cn the ecology of ihe 
classroom is generally preferable to one which 
attempts to change the behavior of teachers and 
students. But when a specific classroom prob- 
lem seems to call for combined modifications 
in both ecology and behavior, an emphasis on 
ecological change usually enhances the effective- 
ness and efficiency of the strategy. 

For example, we wish to collect continuous 
time data for each student's performance on 
micro tasks. We know: 

1. Every classroom has a wall clock. 

2. “Time-telling” skills are already a part of 
Ihe entering behavioral repertoire of all teachers 
and most students beyond the second grade. By 
using the students' 1 skills, the teacher's time is 
available for other activities more appropriate 
to her role and training. 

3. Individualized programed curriculum male- 
rials are available in the UMREL program lo 
teach the complex lime-telling skills to students 
by the end of first grade. 

4. We also want time data on Ihe performance 
of kindergarten and first grade classes and of 
new sludents entering the system at other 
levels, including their time data on their pro- 
gress through a complete time-telling sequence. 

Specified in this way. the problem can be 
solved by introducing a digital dock ( S 1 0) into 
these classes, accompanied by a minimum in- 
structional program with the following sequence 
of objectives: 

1 . The student is able to fill in mark-sense 
dots quickly (3 seconds per mark) with accept- 
able quality and density. This is taught by 
first demonstrating and contrasting acceptable 
and unacceptable marks and then prescribing 
several practice sessions on sample grids and 
evaluating in terms of quality, density, and 
speed. 

2. The student is able to match numbers one 



through twelve to sample with IOC"? accuracy. 
This is taught using a demonstrate-prompt-release 
procedure of the following type: 
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3. The student is able to match three columns 
of the same numbers with 100/$ accuracy. The 
same procedure is used, as for example: 
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4. The student is able to discriminate “Begin" 
columns and “End" columns taken from the 
PPDF (see sample frames below), locate these 
columns when given a complete PPDF, and 
execute and sequence all these skills with 100% 
accuracy during a microtssk cycle. 
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The objectives are prescribed in a series of 
microtasks, each following by evaluation and 
RE. The material is presented on worksheets 
and on actual PPDFs, and supplementary prac- 
tice problem-sheets (where necessary). Each 
microtask is introduced by verbal instructions. 
The size of the microtasks and the rate of 
progress through the sequence of objectives 
varies with the student's demonstrated ability 
with the skills. Preliminary results with 39 
kindergarten students indicates that the program 
fulfills the objectives in from 30 minutes to 2 
hours of class time. 
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Behavior Observation Guide 



Donald J. Christensen and Robert W. Hendon 

1 cachets a re in I lie behavior-changing business 
and therefore musl know when behavior has 
been changed. I hey must be able to obsen e the 
sludenl actions and report objectively 1o them* 
selves and others. One test of objectivity is 
reliability: observers must report the vatnc 

tiling when tool inf at the same event. 

f orty-five observation systems were surveyed 
and onl> four schemes were found which at- 
tempted to record obsen able behav iors of sub- 
jects the major ih of studies and procedures 
Mineyed were subjective approaches whkh re- 
quired the obsen or to classify behavior in what 
one might call covert behavioral den rip lion, 
ihose designs whkh required that the observer 
infer cognitive or socio-ernolional conditions in 
the subject coukl not meet the requirements of 
reliability and eommunk'ability of measures. 
I hey lokl more about the bias of the observer 
than about the behavior of the subject* 

After a thorouth review of the literature and 
extended discussions w ith the Liberator) staff, 
it wa s concluded that ar»v otve* national system 
whkh might be developed should he objective 
and should Incorporate the teacher as an observ- 
er of pupil behavior I xisimg designs were erit- 
ki/cd because they did not provide the teacher 
with useful means to secure adequate behavioral 
data about pupils. 

An objective of thh project was to develop an 
approximation to mutually exclusive and ex- 
haustive obsen at ion categories of pupil per- 
formance through the use of videotaped class- 
room behavior. for training observers in record- 
ing and obw ning pupd behavior If teachers are 
inbred to differentiate behavior emitted by chil- 
dren In the classroom. they will then be able to 
apply wch d»n knowledge in the classroom 
illct the training period. Videotape of actual 
class roo m behavior results in very realist ic simu- 
lation*. Having had such training. teachers 



should not infer qualities or traits that arc 
founded in dubious cognitive structures. 

Once the categories of behavior were estab- 
lished. the conceptualization was further ad- 
vanced by specifying what constituted an ob* 
senatorial skill. The behavior called “observ- 
ing" was defined as a response in the presence 
of a definable environmental event. The envi- 
ronment was divided into home, school, and 
not home or school. T he area of study 
was further limited to the school, and with- 
in that environmental sector, to the class- 
room. bnvironn.cntal cor.Jitions and response 
categories were dichotomized into statie/mo- 
bile. interaction non-interaction, self-initialed/ 
other-initiated, with peers with adults, audi- 
ble/inaudible. A matrix was doised with 
environmental conditions on lire vertical axis 
and response categories on the horizontal axis. 
Subjective and inferential components were re- 
moved from the matrix. Since all possible re- 
sponses cculd not be listed as a guide for teach- 
ers. ninety-one were selected as encompassing 
practically all classroom behaviors. 

To train observers to identify and record bc- 
havk*r according to developed categories, two 
ten-minute videotapes showing samples of school 
childien's classroom behaviors were assembled. 
The tapes and the observation gu Me were tested 
with several groups and a refined guide was 
produced. 

To test reliability, the refined guide was 
tested. A tourer was sounded to focus the 
attention of observers on a behavior. At the 
first check, observers were instructed to report 
the behavior emitted just before the tou/cr 
sound This strategy yielded spurious results and 
was abandoned in fa^or of recording behavior 
evident at the sound of the toiim. In the final 
observation*. reliability of .78 among 24 obscrv- 
ers was measured by the Kuder Richardson and 
Hoyt method. 
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The study is an example of a successful at* 
tempt to develop a recording system 3s a first 
step toward training teachers to observe objec- 
tively their pupils' behavior. Videotaped behav- 
iors provide a close analog and are accepted by 
observers as realistic simulations. Children soon 
ignore the presence of a camera in the class- 



room. and their behavior becomes natural. 

It was recommended that the observation 
guide be revised after field-testing with teachers 
and that further studies be undertaken to deter- 
mine if the behavior of teachers, administrators, 
and other school personnel can be measured by 
this method. 



* 
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Does“Behavioral Management"Turn People On? 



Dean A. Horwtschlager and Gary G. Dodge 
The Problem 

When llie Laboratory began its present pro- 
gram, there was little evidence about educators* 
responses to words which describe behavioral en- 
gineering practices, but experiences of the Labo- 
ratory staff and reports in the literature implied 
that certain words such as behavioral engineer- 
ing, management, reinforce, etc., might prompt 
responses which interfere with the acceptance of 
ideas. As the Laboratory continues to develop 
behavioral engineering training procedures, it is 
important for it (o know: (I) do educators 

respond differentially to specific words which 
arc associated with behavioral engineering? and 
(2) are there differences in responses to these 
terms among different educator groups: Le., 
teachers, school administrators, college profes- 
sors of education? 

The Study 

The measurement instrument used in the 
study was a semantic differential questionnaire 
developed by the Labor-lory and based upon 
work by Charles E. Osgood. George ). Suci. and 
P cry H. Tannenbaum and described in their 
text, The Measurement of Meaning The study 
used responses to the semantic differential as an 
indication of altitude towards the concepts pre- 
sented. Osgood, ct al. say, ,f Thc major prop- 
erties of attitude that any mtasuremenl tech- 
nique is expected to index are readily accommo- 
dated by the procedure. Dinetbn of attitude, 
favorable or unfavorable, is simply indicated by 
the selection of polar terms by the subject: if the 
score falls more toward the favorable poles, 
then the attitude is taken to be favorable and 
sice versa. A score that falls at the origin de- 
fined by 4 ’ 4 " on the scales is taken as an index 
of neutrality of attitude, intensity of attitude 
is indexed by how far out along the evaluative 
dimension from the origin the score lies: i f ., the 



polarisation of the altitude score. Although on 
a single scale, there are only three levels of in- 
tensity: "slightly, 44 “quite. 44 and “extremely 54 in 
either direction, summing over several m 'native 
scales yields finer degree of intensity, 4 ’ (OsgooJ. 
19 * 7 > 

The target populations for the Laboratory's 
training programs arc inservice teachers and pre- 
service teacher trainees, but we are also con- 
cerned with those persons in positions to make 
the decision to initiate a training program. 
Therefore, the populations sampled were ele- 
mentary and secondary classroom teachers, 
school administrators, and college teacher train* 
ers. The tea hers and administrators were 
chosen randomly from a list r presenting a ran- 
dom sampling of schools in the Laboratory's 
five-state region. College professors in depart- 
ments of education were randomly selected 
from a list of all colleges in the region. 

A master list of terms relating to behavioral 
engineering was compiled from recent articles 
dealing with the topic. Three members of the 
Laboratory staff independently selected those 
terms which they considered important to be 
ranked, and the 24 terms most frequently 
checked by the three persons were used. The 
scales were chosen from the Osgood text and 
represent evaluative scales with greatest purity 
on dimensions desired for this study. ( Osgood. 
/ 9.5 7 ) 

Results 

Question i Do educators respond differen- 
tially to terms associated with beba\ioral en- 
gineering* If we assume that each individuals 
ranking is an estimate of the word ‘ true tank 
order, we can us? the rank order of the average 
rank assigned to words to arrive at our estimate 
of this true rank fhattrr. i9SM It can be 
assumed that the ranking of Ihe sample repre- 



sc.its Ihe true ranking of terms within the select* 
cd populations. The mean response score for all 
words over all n was + 1 .08 (on a 7 scale of *3 to 
+3). All groups were the same on relative rank- 
ing of words from high to low’. The mean 
scores were averages for all three groups, hut 
the same order held In each group separately. 
(See Table / ) 



square analysis of the variance if there is a 
difference in how each group scored on theSDQ. 
(Sec Table 2) When ranking all 24 words to- 
gether in overall words, chi square was signifi- 
cant at the p v 005 level; i t., there is a 99.5^ 
probability that the three groups are not from 
Ihe same population, or that they arc not the 
same. 
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Que\thm 2: Are there differences in responses 
to Ihe Icrms associated with bchasioral engineer- 
ing among educator groups? Analysis was done 
by the u« of Friedman Rank TesttFRTV This 
is a null h)polhcsrs lest which states that there 
is no difference between groups on scoring the 
Semantic Differential Questionnaire <$[)Q) The 
lest is a non parametric analysis to test if the 
sample groups are drawn from the same popula- 
tion. If all are from Ihe same population, then 
there should be an equal likelihood of any one 
group-score being higher than another; l.e., rank- 
ing of I. 2. or 3 on score level should result in 
each group basing an equal number of I**. 2\ 
and 3 V The FRT checks the sum of the rank 
scores for each group and determines by a chi 
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Inferences 

The following inferences can be drawn from 
the data: 

1. Thtre is a generally positive disposition 
to behavioral management language. 

2. Education groups respond differentially to 
terms related to behavioral management. The 
classroom teacher’s evaluative rc action to behav- 
ioral management terms is even more positive 
than the administrator** but less positive than 
the university professor**. 
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Critical Events in Implementing 
Behaviorally Engineered Classrooms 



Dean A. Honetschlager and Robert H. Pinney 

In establishing tlic Laboratory's 20 bchav- 
iorally engineered classrooms. a somewhat coin 
plicated job because the classrooms were spread 
out in four quite different schools in two differ- 
ent states, the Laboratory staff was faced with 
two broad classes of constraints. 

The first class of conslrainls was imposed by 
the Laboratory's program. I) The behaviorally 
engineered classrooms had to be teachcr-impfe* 
mented and teacher-maintained, and 2) they 
had to be set up in an on-going school situation. 
3) The classroom management system had to in- 
clude measurement operations for the collection 
of multiple baseline pupil data, and 4) it could 
not require structural changes in the room. 

Non-program imposed constraints included; 
I) the geographical spread of the sites. 2) the 
diversity of the pupil population, 3) a limited 
number of Laboratory staff members, 4) skill/ 
knowledge deficiencies in the teacher popula- 
tion. :>) limited financial suppotl from the 
schools, and h) the lack of instructional objec- 
tives and adequate commercially prepared pro- 
gramed materials. 

With these “greens*' and the information de- 
rived from a detailed deficiency analysis, a flow 
chat! for the effott was developed, critiqued, 
and revised. fS<r /If H This fk>w chart re- 
flects the objective* that had to be met in order 
to insure successful implementation of the new 
educational system. 

As reflected in the chart, the laboratory 
staff had to meet six major objectives: 

I . training teachers and aides. 



2. data collection. 

3. specification of instructional objectives and 
acquisition of materials, 

4. orientation of pupils to the new system. 

5. specification of reinforcing event activities, 
and 

6. design and layout of each room. 

Meeting these objectives required that atten- 
tion be directed toward such interdependencies 
as: 

1. the acquisition and training of Laboratory 
staff. 

2. other Laboratory activities. 

3. delegation of responsibility, in and out of 

the Laboratory* 

4. cost accounting, and 

5. support needs, like equipment, publica- 
tions. non-professional help. 

Management of implementation was carried 
out according 1o the specifications of objectives, 
irrc lines, and personnel. Some of the out- 
comes of this implementation are: 

1. training programs for teachers, aides, and 
pupils. 

2. a model for ini pfemcnla lion of behaviorally 
engineered classrooms. 

3. a specification cf the necessary features 
for a research development program to be 
located in the school. 

4. prompted need for first inputs !o con- 
tribution to an instructional objectives and 
curriculum materials bank. 

5. petformarve d*la gathering on teacher*, 
aides, pupils, and Laboratory staff. 
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Student Involvement in RE Selection 



^ary G. Dodge 

Problem To identify reinforcing events (REl 
for use in upper grade self-contained, contin- 
gency management (CM| classrooms. After 
four months* experience with a reinforcing CM 
system, toll. 7th and 8th grade pupils still did 
not have a direct input into decisions about Rl s 
available to them in the classroom. A method 
was sought to investigate student leisure ar.d 
free lime activities to better identify possible 
reinforcing events for classroom live. 

Method. A three-page questionnaire was 
developed and administered to the class as ar. 
alternative to the preferred approach of direct 
behavior observation. The questions were open- 
ended and directed at out -of school activities, 
favorite games and interests, use of free time 
in school, spending of money, and suggestions 
for improvement of the current Rt area. 

Result*. The results arc combined for the 
three grades and arc not listed by frequency 
but by groupings of related activities. 

I . Activities 

1.1 TV, radio, records, comics, movies, tape 
recorder, books, magaiines 

1.2 scrabble, checkers, chess, monopoly 
cards, sorry, bingo, cribbage, frustration ball, 
pu/iks 

1.3 art. draw, paint, sew. cook. type, models, 
caning, chemistry, electricity, crafts, car and 
bike repair 

1.4 pool, twister game, ping-pong, marbles, 
jacks, darts, yo-yo. football-hockey games, 
pin ball type games, slot ears, battling tops 

1.5 animals, fish, collections hobbies. natu- 
ralist (leave's, rocks, shells) 

1.6 dance, gym. bowl. walk, roller skate, 
slide, skite. swim, football, bike. sing. camp, 
hunt, horse. Held trips 

1.7 food, incense, conversation 



2. Environment 

2.1 pictures, posters, drawing', black board 

2.2 clean, rug. table surface, chairs and 
pillows 

2.3 adequate time, food availability 

OiHUttfon. Urn list prov ided tcaclurs with a 
guide for identifying deficiencies in the present 
RE area. New events could be obtained subject 
to availability of money, decisions by the class, 
and acceptability to the teacher 

Problem. The list indicated that more space 
was needed in the RE area to allow more active 
events and to increase the number of events 
available within social physical, and system con- 
straints. 7 he need for more space led to an anal- 
ysis of room traffic patterns and storage of mate- 
rials. This resulted in some decision rules for 
efficient arrangement of the classroom into task 
area, progress check area, and RE area 

1. Get multiple use out of shelves, cabinets, 
movable storage by 

a. using for room dividers 

b. using top also for storage 

c. using as resource material storage 

2. Pupil desk placement, task area 

a. place in least active end of room 

b. place bavks of chairs against wall to clinv 
mate dead wall space 

c. have no active resource access in desk 
placement area 

d. have no access aisles through desk area 
Tunneling to focal, active access points 

e. place so that visual stimuli is minimized 
if paper tasks are general routine 

f. pi ace sc that \ to 2 feet separate cash desk 
with no pupils directly facing each other 

3. Use unused areas as RE area*, eg, coat 
rooms, sinks, normal room egress lanes, dead 
book storage areas. Use as active RE ar:as 
and revert to one-shot use at appropriate 
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times, e.g., to get coats, to leave room, to 
use sink 

a, attempt to move task area away from 
these dead areas so that they can be used 
as RE areas 

b. do not be concerned with break up of 
space as long as RE areas arc contiguous 
and relatively easy to access visually by 
teacher and aide 

4. Teacher desk, active resource material use 



a. place centrally with highest used items 
most easily accessed 

b. place near task area with easy teacher con- 
trol 

c. use, if possible, as additional room bound- 
ary space definition, e.f,, teacher desk 
placed as task area boundary, resource 
materia! near desk 

d. separate RE area traffic access from re- 
source area traffic access 
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Happiness is a Beautiful PPDF 



Patricia A. Pool and Chu pin Chu 

Shortly before UMREL began (o use a revised 
version of the PPDF, the Laboratory slaff check- 
ed the acceptability for machine scanning of the 
d; ta being collected on the old PPDF then in 
use. This acceptability cbeck revealed that 50% 
of the PPDFs were meef.g ihe 100% criteria 
level for correctness of dff u entries, i.c., dark 
enough for machine scanning and free of data 
entry errors. 

Machine scanning and computer analysis of 
pupil performance data ( t or which properly 
completed PPDFs should be critical) was sched- 
uled to begin in several weeks, but the Labora- 
tory staff decided that enough time remained to 
make a tyst€matlc effort to upgrade data col- 
lection on the PPDF. 

Since it was likely that the initial acceptabil- 
ity levels for the r>ew PPDFs would fall consid- 
erably below the 50% level reached using the old 
form, the change-over to the new version of the 
PPDF gave the Laboratory the opportunity to 
test the effectiveness of procedures for reinforc- 
ing teachers, aides, and students for correctly 
filling out the PPDFs. This approach alx> en- 
abled the Laboratory to take a pilot step into 
teacher incentive programs. 

Procedures 

The basic contingencies were <et up as follows: 
no reinforcement would be given if less than 
25% of the new PPDFs weu perfectly marked; 
when 25-49% were perfect, the teacher would 
get SIO to spend for class benefit; 50-94%: 
S20 more; 95-100%: S50 more, for a total of 
S80. The contingency was in effect only for the 
first week the class met the criterion level (A 
class could not earn SIO each week by holding 
the acceptability level at 25% ) 

Decision rules and a training manual were pre- 
pared showing the correct way lo mark the 
PPDF. and common mistakes to avoid. 



Each individual panel on the PPDF w as check- 
ed for data entry. Teachers and Laboratory 
staff responsible for the classrooms were inform- 
ed of the number and percent of PPDFs which 
reached 100% acceptability, and of the types of 
errors made. If one entry rule was violated con- 
sistently, the teachers were given an explanation 
of the specific error and the method of correct- 
ing it. 

Results 

No class reached the 25% level during the first 
week of the study, but by the fifth week only 
one class remained below the 25% level, 15 clas- 
ses had reached the second level, and 3 classes 
had reached the 90% level. Each week several 
classes met higher criteria levels. 

Notices that they had reached the various ac- 
ceptability levels were presented to the teachers 
by the implementors, who also notified the 
school administrator to release the reinforce- 
ment money. (Management by the school ad- 
ministration of a performance contingency fund 
for teachers is of particular interest because of 
its relationship to UMREL's school functions 
analysis.) 

The use of the money was controlled by the 
teacher, who decided how much the aide and 
students should participate in the purchase of 
items for the darroom. In the upper grides 
where the teachers had given the students re- 
sponsibility for correctly filling out the PPDFs. 
they also allowed them to deckle what to buy 
with "their** money. Some of the lower grade 
teachers divided the money in half, spending 
part for items of interest to the girls, and the 
other for items of interest to the boys. Some 
classrooms purchased one or two expensive 
items- double easel, pod table; others purchased 
many smalt items like games and handicraft ma* 
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tcrials. One clas> threw a party and spent the 
mqney for refreshments. 

Conclusions 

I. Use of the training manual coupled with 
specific reinforccrs for properly marked PPDFs 
appeared successful in upgrading the acceptabil- 
ity for machine scan of data collected on the 
PPDFs. 

Achieving the 50^ criteria docs not mean that 
only of the data was usable, Each PPDF 
contains up to 200 ilems of data about a stu- 
dent's performance, and each student uses four 
to six forms per week (one for ever)* curricular 
area), generating up to 1200 items of data per 
student per week. If a marked PPDF has only 
one item missing, incorrect, or incomplete, the 
whole form is counted as mo for the purposes 
of this reinforcement plan. A class of 25 stu- 
dents can collect up to 30.000 items of data per 



week, yet if only 20 of these items are incor red- 
ly marked, the class receives a 50* rating. Clear- 
ly the criteria were severely demanding. Never- 
theless. by the fifth week 15 of 20 classes were 
at or above 50^ . guaranteeing a massive amount 
of significant and usable multiple-baseline data 
on student performance. 

2. More detailed preparations should be made 
before introducing such a scheme to teachers. 
Although the original idea came from a teacher's 
suggestion that nionfy f r her classrooms would 
be very’ reinforcing. th£ was not true for all 
teachers. Several reported that receiving money 
for work which was "part of their job 1 * was de- 
grading. Another thought at first that the mon- 
ey was to be spent on)j r for RF items, and was 
concerned about having to “earn" funds for ar> 
a~ea she considered sital However, all teachers, 
when their clashes earned the money, were cm 
thusiastie about receiving it 



Videotape as a Classroom Observational Tool 



W. Scou Wood and Atlen L. Sova 

UMREL has shown that dosed circuit tele- 
vision monitoring and videotaping is an effective 
behavioral observation tool. The Laboratory’s 
technique involves mounting television cameras 
in individual classrooms, and monitoring and 
videotaping in a centrally located control room. 
Behavior in the classroom can be observed by 
one or more observers, either as it occurs via 
closed circuit, or later da videotapes made at 
the same time 



The number of students under observation i« 
determined by the nature of the investigation, 
the camera’s range, and the complexity of the 
behavior be in* observed. 

There are :everal advantages to using the 
videotape observational technique: t) compared 
to a classroom observer, the camera is relatively 
unobtrusive, and quickly becomes ignored by 
the students, 2) the technique is very flexible, 
in that multiple lenses allow the camera to be 
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One effective technique involves use of the 
videotape's audio track to record instructions to 
the observer. For example, while the videotape 
shows a group of students, the audio track tells 
the observer whkh student to watch, how long 
and what behaviors to record. This kind of rec- 
cording can be achieved by simultaneously film- 
ing the classroom and playing a tape-recorded 
pacing message onto the audio track. Of course, 
the audio track can vary in complexity from a 
simple counting of minutes to a comphr se- 
quence of instructions to the observer. These 
audio pacing techniques arc parlkwtarly valuable 
when the data recording method Is of tie “time 
sampling" type, where one student is observed 
foe a period of time (usually from 1 5 seconds to 
a minute), then a second student, a third, etc. 



focused upon a single student, a smalt group of 
students, or the entire classroom, J) recording 
is permanent, 4) behavioral observations can be 
made at any lime, by any number of Individuals. 
In addition, the observer can easily "rerun” any 
questionable portions of the videotape to insure 
accurate recording, and $) the method b quite 
reliable. Use of the overlaid audio paring tape 
assures that two or more observers see the same 
data at the same time, resulting in high inter- 
observer reliability measure*. Tabk I presents 
the reliability percentages from a series of ob- 
servations the Laboratory has made using the 
videotape methodology. 

The eeM/effectfveness payoff of the video- 
tape observation procedure increases as the 
number of ohrcnwrioni and observer* increase* 



JJ 



I J i is i> j function of: 

!. observations not being restricted to the 
“school Joy.** i c.. delayed observation. 

reduced travel time and expenses for mul- 
tiple observers; observations, 

3. permanent recording that can be later 
observed for nthcr behavioral information, and 

4. being able to train observers “in-house 1 * 



rather than “iivdassrooni.* 1 

Naturally, the Upper Midwest Regional l:d- 
uealional Laboratory has many uses for equip- 
ment of this type, and classroom observation is 
only one of them. However, this use does help 
meet the Laboratory *s need for a highly re- 
liable, flexible, classroom observation method- 
ology. 
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A Specific Educational Role for 
the Classroom Aide 



Paul R. Petrafeso 

When federal funds were made available to 
school districts for hiring classroom teacher- 
aides, administrators and teachers alike hailed 
the move as a great leap forward in upgrading 
our educational systems. The use of teacher- 
aides was seen as an innovation that would give 
teachers more time for improving their leaching 
skills, for bettering their curriculum materials, 
and for helping individual students. 

The question should now be asked: “How 

has the use of teacher-aides affected student 
performance? 11 According to statistics from the 
United States Office of Education, simply using 
teacher-aides produces no significant change in 
student achievement. This is particularly true 
in schools serving disadvantaged populations. 
Clearly no one thought the use of teacher-aides 
alone would shore up our sagging educationat 
system, but some benefits were anticipated. 
What happened? 

The teacher-aide programs, like so many other 
promising innovations, are not at fault; those 
who implemented the idea should be blamed 
for any failure. They have usually been guilty 
of inadequate conceptualization and planning, 
and the responsibility for the results should 
rest firmly on their shoulders. 

Examine the role of the teacher-aide in the 
classroom and what do you find? A recent fact- 
finding tour of nine Indian schools in the North- 
west, conducted by the author, uncovered some 
possible reasons for failure of teacher-aide pro- 
grams. In the schools studied, aides had been 
hired with no specific training for their jobs in 
the classroom, In fact, most never got into the 
classroom. Many aides were used primarily for 
odd jobs and errand running, and any training 
was not preplanned but given only as necessity 
or crises arose. 

The aide’s duties seldom had anything to do 
with improving education. She was kept busy 



with low-level filing, making posters for display 
purposes, answering the telephone, helping the 
cooks, supervising the playground, and in schools 
where weekly showers were required, she watch- 
ed over the children in the shower room. If 
the aide was highly qualified, she did some 
typing, operated the copying machine, and ran 
the slide projector, although this job was usu- 
ally claimed by the audio-visual staff member. 

The use of teacher-aides becomes effective 
only when it is coupled with specific training 
objectives that result in measurable behavioral 
outcomes not only for the child, but for the 
aide and the teacher as well. 

In the Laboratory’s bchaviorally managed 
classrooms, the teacher-aides are employed and 
trained to carry out tasks directly related to 
child learning. This frees the teacher to devote 
her time to her primary function-individual 
prescription and instruction. The aide is specif- 
ically trained to (I) keep daily records of stu- 
dent progress, (2) evaluate student tasks based 
on teacher-established criteria, (3) maintain class- 
room control also based on teacher-established 
criteria, and (4) maintain the supply of RE 
items in the reinforcement area. 

In addition to these functions, the Laboratory 
has expanded the role of the aide considerably. 
Under th^ Laboratory’s program the aides are 
seen as representatives of the community who 
make meaningful contributions to the chil- 
dren’s education. 

The Laboratory’s behaviorally engineered 
classrooms on the Red Lake Indian Reserva- 
tion, where all aides are members of the 
Chippewa Indian community, offers an example 
of this expanded teacher-aide role. Qassroom 
aides like these can provide valuable informa- 
tion regarding what may be reinforcers for 
these Indian children, or they may act as cultural 
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re inforcers themselves, strengthening the stu- its other experimental sites that when aides are 

dent’s academic performance by their presence assigned specific duties, and are given specific 

and approval training, they can make an important contribu* 

The Laboratory has shown at Red Lake and tion to the educational process. 
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Prerequisites for Systems Analysis in Education 



William M. Ammentorp, Marvin F. Daley end David N, Evans 



Like other applied behavioral sciences, educa- 
tional administration is beginning to make con- 
siderable use of the terminology of general sys- 
tems theory. The perspectives of systems analy- 
sis have much to offer educational administra- 
tors, but to produce results, the implementation 
of systems theory requires full use of the basic 
conceptual and analytic tools of systems analy- 
sis. Intuitive grasp of the method is not enough. 

With analytic methods designed to deal with 
multiple variables, the systems analyst concerns 
himself with the broau area of decisions and re- 
sults, concentrating on the basic processes under- 
way in an organization. Shipment of grain to 
flour mills, maintenance of parts inventory for 
auto repair, and formal education of children are 
all processes he can study systematically. For 
each organization, whether educational or indus- 
trial, the analyst considers the output data and 
its functional relationship to the variables under 
organizational control. 

In a school, the central output datum is 
change in a child’s behavior; the system variables 
are teacher behavior, subject-matter materials, 
and reinforcement practices. Following fle gen- 
eral stimulus-response-reinforcement learning par- 
adigm. acquisition of a particular behavior by a 
child is functionally related to conditions of the 
environment controlled by the teacher. By exam- 
ining several classrooms, the analyst can deter- 
.mine the three-way relationships between the 
child’s behavior, type of reinforcement activity, 
and timing and frequency of reinforcement. 

Several interlocking administrative roles emerge 
as systems concepts are applied to an educational 
organization. Someone must manage the school’s 
daily operation, research must be carried out to 
evaluate the relationships between variables, and 
new designs must be developed to meet future 
educational needs. 

Th c system manager, roughly equivalent to the 



superintendent or principal in traditional school 
organization, identifies the system’s constraints 
and possibilities: the variables. He locates prob- 
lems or decision points in organizational activity 
and selects courses of action. 

System researchers assist the manager by feed- 
ing information back to him on the likely conse- 
quences of his decisions, based on their on-going 
analysis of the relationships between the system’s 
variables. 

The system designer combines the data pro- 
vided by the managers and researchers, with his 
knowledge of operating systems ar>d processes to 
produce new designs. His overall view of the 
process of education makes him a common link 
lor the more practical managing and research 
roles, and he easily serves as a trainer for these 
areas. 

To function effectively, managers, researchers, 
.and designers should have substantial foundations 
in systems analysis, along with their understand- 
ing of learning and educational theory. The sys- 
tem manager should have skill and experience in 
identifying variables, planning and flow analysis, 
and decision-making. These skills could be de- 
veloped through a basic program of elementary 
decision theory, and finite mathematics, training 
him in a logical problem-centered approach to 
probability and the numerous applications of 
probability anlaysis beyond simple statistical use. 
Along with this background, the systems man- 
ager should have introductory experience with 
data systems and planning techniques, acquired 
through analysis of simple problems using com- 
putational aids, and in planning complex activi- 
ties using PERT or similar techniques. If pos- 
sible he should follow some elementary work in 
operations research to facilitate communication 
with his supporting research operation. 

A system researcher needs the same skills as 
the manager, along with thorough training in 
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process analysis, similar to that currently offered 
in federally sponsored programs in educational 
research. 

The system designer must have extensive train- 
ing in probability analysis and in information and 
communication theory. He should be aware of 
any technological and social changes which might 
influence new system designs, and he must keep 
abreast of contemporary research on learning as 
a basic system process. 

The manager and researcher function as a man- 
agement team, dealing with the realities of the 
particular organizational system and providing 



data for the designer as he plans new systems; 
with their perspective, they serve as a reality test 
for new system designs. The productivity of per- 
sons filling all three roles depends directly on 
their mastery of the tools and methods available 
for systems analysis. If education is to benefit 
from systems analysis, educators must have the 
tools to analyze systems. 

The concepts expressed in this paper ore fur- 
ther developed in the authors* article in Educa- 
tional Technology, August 1969. 



Inservice Credits as Reinforcement for 
Teacher Behavior 



Rodney L, Snyder 

Since teacher behavior and student perform" 
ance are functionally related, ;nd since the ef- 
fects of reinforcement on behavior apply to 
teachers as well as students, it is appropriate to 
reinforce those teacher responses that result in 
increased student performance. The Upper Mid* 
west Regional Educational Laboratory has ad- 
dressed itself to (lie development of strategies 
for teacher reinforcement that have the follow- 
ing properties: 

1. sequenced behavioral objectives that spec- 
ify teacher behavior systematically and function- 
ally related to student performance; 

2 . training and practicum in management 
skills that lead to teacher attainment of objec- 
tives; 

3. assessment of teacher performance with 
student performance as the measure; 

4. identification of teacher reinforcers which 
arc practical and useful in the school; and 

5. delivery of immediate reinforcement, con- 
tingent upon teacher behavior that meets the ob- 
jectives. 

One common reinforcement strategy involves 
the use of salary-tied inservicc credits as rein- 
forcers. Many schools have attempted to develop 
“good teaching” by reinforcing the teacher's 
completion of inservice education courses with 
credits that apply to salary increases. In 
Minneapolis, where this approach is used, the 
total annual inservice class enrollment nearly 
equals the teacher population. 

In its efforts in classrooms in the Minneapolis 
schools, UMREL proposed to use inservicc cred- 
its to reinforce the specific teacher behavior that 
affects student performance. 

In order to measure the effect of teacher be- 
havior on student learning, an environment has 
to be established. Teacher acquisition of skills 



and knowledge requisite to implementing such 
an environment became the first general objec- 
tive for which a one credit reinforcer would be 
delivered. 

Secondly, to measure the effect of teacher be- 
havior on student learning, the teacher has to im- 
plement and maintain a continuous data record- 
ing system on pupil learning behavior. The ac- 
quisition by the teacher of requisite data record- 
ing skills became the second general objective for 
which a second credit rein forcer would be deliv- 
ered. 

Finally, ufh * the establishment of an environ- 
ment in which continuous data collection on stu- 
dent performance takes place, the teacher would 
have the opportunity to systematically manipu- 
late variables of her own behavior. The assess- 
ment of the effectiveness of sueli manipulations 
would be judged by their effect on student per- 
formance. A chi ref credit reinforcer would be de- 
livered for self-directed teacher behavior that ef- 
fects change against baseline in individual student 
performance. 

Each of the preceding three general objectives, 
comprising complex patterns of behavior, arc 
broken down to specific behaviors, and slated as 
behavioral objectives. For example, “establishing 
an environment....” involves functionally arrang- 
ing the classroom. A specific behavioral objec- 
tive would be. “the teacher, after completing the 
instruction in contingency management and after 
designating an evaluation area in her classroom, 
will locate the aide's desk so that the aide will 
have visual contact with the evaluation line, the 
reinforcement area, and the clock.” 

Given this level of specificity, teacher’s behav- 
ior can be measured, and reinforcement can be 
delivered contingent upon jhe emission of the 
behavior. 

Since a credit rein forcer can only be deliv- 
ered afler the teacher has met a series of objec- 
/ 
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lives comprising a complex behavioral pattern, 
intermediate reinforcers in the form of points 
counting toward the credit will be delivered im- 
mediately after the teacher meets each separate 
objective. 

UMREL’s initial proposal for this type of rein- 
forcement procedure was made to the Minnea- 
polis Public Schools Director of Staff Develop- 
ment in April 1969. In October 1969 the 



Minneapolis Inservieo Committee approved three 
inservice credits contingent on the teacher’s 
meeting UMREL’s specified objective. The 
training is elective and open to the teachers of 
Hay Elementary School in Minneapolis who 
operate contingency managed classes under the 
joint sponsorship of the Minneapolis Schools 
and UMRHL. 



! 
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Establishing Relationships for Research - Based 
Development in Schools 



Dean A. Honetrchlager and David N. Evans 

Research and development groups which are 
trying to establish cooperative relationships with 
schools often find that the usual change models 
will not work for them. The change models 
most commonly described in the literature, 
emphasizing problem identification, resource 
search, group decision-making, and commitment 
built through the activities of internal change- 
agents, may prove inadequate. 

Usually in these models, a specific change is 
sought in one point of the educational system, 
and little or no attention is paid to the main- 
tenance of continuous change which is necessary 
in a development program. The series of re- 
search problems which evolve out of a develop- 
ment program, the interdependencies among 
the gross variables, and the cost-effectiveness 
of changes seem to be peculiar to R& D/school 
cooperative efforts. 

The Regional Laboratory requires a relation- 
ship with a school which will allow it to make 
a variety of interdependent well-planned changes 
in the instructional system. These changes may 
be unrelated to the immediate needs of the 
teacher and pupil, and results may have no 
immediate implications for improving education 
in that particular school, but the research may 
be of high significance in extending knowledge 
about a component of the instructional system, 
refining theory, or contributing to an under- 
standing of interrelationships.. Data are often 
collected to secure useful information about 
children’s interests and other characteristics, 
teacher behavior and other phenomena, all of 
which eventually may bring about better educa- 
tion. 

The required changes, research design, data 
collection procedures, and human interfaces, are 
determinedl by the research agency outside the 
school, and extra demands on the school may 
be necessary to permit systematic execution of 



experimental efforts. This obviously means that 
the people in the experimental situation must 
agree to perform the prescribed behavior, so 
that what is designed to be tested will be tested. 

It is the Laboratory's experience that school 
districts and school personnel are willing to 
participate in change activities which are exter- 
nally conceived. School governing boards are 
looking for changes which promise measurably 
better school experiences for their student popu- 
lation. For teachers and administrators, satisfac- 
tion from observable gains in student learning, the 
excitement of w orking in an innovative program, 
the professional relationships with outside con- 
sultants, and the attention and recognition by 
peers and the unusual stream of visitors make 
the additional effort worthwhile. Many see the 
identification with potentially successful pro- 
grams as an important step in career advance- 
ment, and they are proud to bring an innovation 
to their school. 

In establishing a relationship with schools, it 
is important that advantages and constraints be 
spelled out clearly and are accepted by all 
parties from the beginning. The Laboratory can 
offer these assets to the school: 

LA research based irnovative instructional 
system. 

2. A measurably better school experience for 
students. 

3. Well-designed retraining programs for teach- 
ers and administrators. 

4. Continuing public relations assistance with 
community and parents. 

5. Professional personnel to maintain the pro- 
gram and to serve as consultants with the school 
personnel. 

6. Continuing interpretation of progress and 
findings to the participants. 

7. Opportunity to participate in education 
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research and development of potential high- 
value and contribution to education. 

In achieving a cooperative relationship for 
conducting research and development, the Labo- 
ratory arrives at general agreement of cooper- 
ation and monetary commitments with the 
parent governing board. Then face to face 
negotiations between Laboratory implementors 
and school administrators and teachers are con- 
ducted. 

The following is the set of guidelines upon 
which discussions leading to a contractual rela- 
tionship arc based. The end result has been 
satisfactory, cooperative relationships establish- 
ed with teachers and administrators at the four 
sites which constitute the laboratories for re- 
search based development. 

Arrangement Necessary at Research and 
Development Sites 

I. Decision-making power shared by the 
school administrator and the Educational Labo- 
ratory in such areas as introduction of special 
programs, control ot visitors and publicity, 
changes in school schedule, and others to be 
specified under special conditions. 

a. The School Board, superintendent, ?nd 
principal should have a thorough first- 
hand knowledge of the essential ele- 
ments of the Laboratory’s program and 
objectives. They should be fully in- 
formed of the administrative require- 
ments of the program. 

b. There is a significant .need for both 
administrator and teacher retraining 
when a district participates in the Labo- 
ratory’s program. The district should be 
fully aware of the nature and the extent 
of this training. 

c. Individual school scheduling should pro- 
vide enough time for teacher data col- 
lection. 

d. Introduction of any special education- 
related program into the school should 
be cleared through the site coordinating 
committee. 



c. Visitor policy should be jointly estab- 
lished by administrator and Laboratory 
so interruption of progress is minimized. 

f. The school principal should be commit- 
ted to research and development in ed- 
ucation and show it through his commu- 
nications with staff and efficient han- 
dling of data collection activities. 

2. Permission to modify existing curricular 
materials and add additional materials. 

a. When curricular material is identified 
which meets requirements or specified 
and sequenced instructional objectives, 
and which is amenable to nucrotasking 
and individual evaluation by criteria, the 
school district will be willing to adopt 
the curricular material on an experi- 
mental basis. 

b. Teachers must agree 10 follow Labo- 
rato r y suggestions in use of curricular 
material. 

3. Access to existing test data in school 
district and permission to test students of the 
cooperating teachers for academic skills, 

4. Permission to collect data and do research. 

a. Permission to use videotape recorders 
for research and reporting purposes. 

b. Permission to permit research staff mem- 
bers to conduct studies in participating 
classrooms. 

5. Assignment of teachers who are committed 
to the research and development program in ed- 
ucation and willing to accept additional demands 
placed upon them during their participation. 

a. District should agree to assign teachers 
to classrooms who are committed to R 
and D program and willing to assume 
additional responsibilities. 

b. Teachers should he willing to take re- 
training on a regular basis wi ile in- 
volved in the program. 

c. Teachers should be willing to accept 
visitors and researchers into their class- 
rooms as part of the normal require- 
ments for participants in the program. 

d. Teachers should be willing to use rc- 
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search model and work with Laboratory 
staff prior to modifying classroom prac- 
tices. 

e. Teachers should be willing to participate 
in data collection a: d reporting efforts. 

References 

L Herbert Klausmeir, Richard Morrow, James 



Walter; “The Multiunit Organization (R & l 
Units) and Elementary Education in the Decades 
Ahead.” In the University of Toledo Elemen- 
tary Teacher Education Program proposal. 

2. University of Pittsburg R & D Center and 
Research for Better Schools are other organiza- 
tions which have identified key variables to 
control for doing research in schools. 



Volunteer Programs ? 



Robert L. William* 

Volunteers from the community can play a 
major role in facilitating the operation of behav- 
iorally engineered classrooms, but oecause of 
the intricate dynamics of these classrooms, these 
volunteers should receive special training to 
develop the skil!/know ledge for successfully 
working in the classrooms. They must be thor- 
oughly familiar with the basic operation of the 
behavioral management system, especially with 
coding and other record keeping procedures, 
supervision of reinforcement practices, and tu- 
torial practices, and they must be keenly aware 
of their roles as links between the pupil and 
teacher and between the school and community. 
They must have an understanding of their poten- 
tial contribution to the total educational process. 

UMREL/s experience has shown that selection 
and recruitment of socirlly responsible volun- 



teers, should be strongly based on the volun- 
teers’ past employment, and on their familiarity 
with the indigenous community. Because of the 
complexity of the volunteer's role in the class- 
room, only those persons should be chosen who 
can regularly devote relatively large blocks of 
time to work in the classrooms. Teachers in 
whose classrooms the vonmteers will work 
should approve all selections. 

Once a working list of volunteer resources 
has been compiled, administrators should clearly 
delineate the behavioral expectations for the 
volunteers as they interact with students, teach* 
ers, and parents. The necessary training should 
be carried out by persons well skilled in the prin- 
ciples and applications of behavioral engineering 
techniques. 
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Analysis in Elementary School Education 



Brian Fitch 

As part of the analysis of educational systems 
an effort is being made to determine what 
administrative tasks must be performed to sup- 
port the instructional processes. 

One objective of this effort is to identify the 
functions of administration which arc integral 
to a specified type of individualized instruction. 
These functions are those interdependent sets of 
action that must be planned to insure that mate- 
rials are delivered when necessary, that records 
arc kept, 1 hat necessary resources arc made 
available, elc. Once these functions have been 
identified, it will be possible to delineate the 
skills and melhods to be employed in carrying 
the functions out. 

There are two strategies which can be em- 
ployed in this process of identification. Using 
the first strategy, a researcher would perform an 
inductive analysis of the functions necessary to 
support Ihe desired system. For this method 
the major effort would be to conceptualize the 
system and to determine the constructs of ihe 
system accordingly. Interdependencies between 
separale aspects of the system would appear in 
theoretical relation to each other and the ideal 
functions could be hypothesized. 

Using the other strategy, the researcher would 
identify the constraints which exist in currently 
operating systems. By observing school person- 
nel on the job, it would be possible to note - in 
a general fashion - how administrative time and 



effort is distributed. A labeling of categories in- 
to which time and effort fall would identify the 
constraints, or limits, of administration in each 
school where observations were made. Such a 
strategy eventually would supply information oil 
which constraints are common to all systems 
and which arc peculiar only to one system. 

By employing both strategies, it may be 
possible to conceptualize necessary functions 
and then to determine how administrative time 
and effort is presently being distributed to ful- 
fill these functions. If present activity docs not 
satisfy system needs, administrators can be 
restrained or technology introduced to d«*ul with 
deficiencies. Conversely, systems may be revised 
while on the drawing board to include desirable 
aspects of present practice. For example, a 
system can be designed for the procurement 
and delivery of instructional materials which 
accounts adequately for every procedural and 
calendrical requirement. However, if variables 
dealing with teacher input to the process are not 
recognized and accounted for in an appropriate 
fashion and at the accustomed time, delivery' 
may be delayed or the material* not used as 
anticipated by system designers. When employ- 
ing both strategies, care must be exercised so 
that the gathering of data docs not prevent 
change to a different system; data must be used 
to provide input to, rather than control of, Ihe 
conceptual design. 
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Schools, Systems, Machines 

Milton C. Hillary, Marvin F. Daley and Robert Q. Packard 



The role of technology in the education of 
today and tomorrow is currently a very popular 
topic. Witness how frequently this subject ap- 
pears in a wide range of scholarly, arid not so 
scholarly, professional, and not so professional, 
periodicals and texts. Some writers sec massive 
intervention of technology as the only salvation 
fora floundering educational institution. Others 
believe even limited use spells doom for hu- 
manism in education the end of all that is 
honored and noble in the art of teaching. No 
matter what the opinion, computers arc a fan- 
tastic extension of human capability, and many 
effective uses are possible. 

Existing educational computer applications 
have not been specified by educational institu- 
tions. Rather, they are the result of projections 
by market analysts and the vendors of hard- 
ware. Historically, computer sales divisions 
rushed equipment to school systems to aid 
operations at subsystem levels, e g , bookeep- 
ing. inventory, scheduling, lest scoring, pay- 
roll. etc. Computers have dramatically improved 
the usually inept manual operation of these sub- 
systems. but in the haste to use computers the 
complex interrelationships of subsystems to the 
total educational process have been disregarded. 
The result is a disjointed effort. 

A rapidly increasing variety of computer 
applications arc being projected in education 
today, but unfortunately many have not attack- 
ed the bask problem. They have failed to re- 
place fragmented, overlapping and/or discontin- 
uous subsystem applications with a total system 
application. 

The present situation can best be described 
in terms of the following two deficiencies 
I) education has surrendered to the computer 
technicians, the responsibility for designing sys- 
tems and software, though the technkians do 
not have the professional educational back- 



ground to accomplish those tasks. 2) com- 
puter applications have been limited largely 
to the fragmented and uncoordinated replace- 
ment of clerical services, e g . inventory, pay- 
roll. scheduling, etc. An evolving and inte- 
grated total system management has been ignor- 
ed. This has created the paradoxical situation 
in which software and local system users dictate 
what all hardware Jiould be able lo do, while 
the vendor decides which specific variations a 
user can have. 

Traditionally, educational management operat- 
ed in this fashion, requesting computer tech- 
nologists to provide a sendee, then sitting back, 
content to acquitc "canned” applkations as 
they became available. The necessary alterna- 
tive is that management build the internal skills 
required to manage and sustain a systems ap- 
proach to management, and then order the hard- 
ware that fits the job. 

Systems logk at UMREL requires j functions 
anal) sis which insures identification of all major 
functions in a school w ith enough completeness 
for informed system design decisions. A reiter- 
ative adjusthe process is employed as a design 
moves from analysis to synthesis, and back lo 
analysis, etc. In this way a system can be de- 
rived from the system design specifications w hkh 
clearly artkulale the performance limits and 
procedural, operational, ecological and design 
constraints. Management planning and control 
insure that the interdependent parts of the total 
system are integrated, functional, and relevant. 

To accomplish this. tTMRTL established a 
working agreement with Biomedkil Computer 
Senkes Incorporated, a liaison whkh represents 
an important contribution of private industry 
lo educational development. BC51, organized 
on a logk similar to CMRf IX has applied this 
strategy to the health care field. Central to 
BCSIs definition of an effective approach to 
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the development of u computer utility service is 
l lie particular interfacing of professional knowl- 
edge and technological vk ill. Unlike I lu* com- 
puter jpplicjlions referred to earlier. B( SI s 
leadership and conceptual development is the 
product of their professional personnel and relat- 
ed technologists vs ho together translate ihe con- 
ceptual model into upiratifitul dmumattatinn 

A significant input in the development of 
UMRI L's “ecological maintenance system" for 
education has been BIS Us cooperative effort 
with UMRI L in the development of an educa- 
tional computer utility service, drawing heavily 
upon the models and procedures established 
for the health-care system. 

In the UMRI l -HUM relationship, locus of 
control for software and hardware elements 
hau' boon properly aligned Ihe user controls 
system-referenced software while the computer 
utility service is responsible for the hardware 
configuration. 

this allocation of control insures results that 
are professionally sound as well as technically 
proficient, and makes possible management sys- 
tems that are oriented toward a specific function, 
but coordinated into an integrated, total s) stems 
management computer utility service, the 
primary source data is identified and then the 
desired flow and use of that data is arranged to 
meet the management objective. 

In education Ihe primary source data comes 
from the suidcnt. his characteristics and behav- 
ior. All systems of an educational institution 
should be based directly or indirectly on this 
primary source data, and the management of all 
instructional and non-in stnalionj I subsystems 
of a total educational system are a k>gkal exten- 
sion of Ihe student source data It should be 
determined what informal n>n d<xs. should, or 
can control behavior within the system: who 
should receive this information; and what ate. 
should, and can be the consequences of receiving 
this information. 

Systems truly sH. documental ton. and comput- 
er-based Information management developed on 
these parameters of student source data can bring 
greater coordinatton to diverse systems func- 



tions. ^ he documented flov. of information 
and continuous analytical monitoring of that 
data and ils consequences provides both a I 
an automatic updating of all subsystems af- 
fected by any input of data and M the genera- 
tion of tested decision rules which can maximize 
the effectiveness of information use. All func- 
tions in the educational system can be handled 
in this way. School managers can use I lie infor- 
mation to decide on the prescription of a learn- 
ing task for an individual student, the selection 
of curriculum materials, the physical and geo- 
graphical specification x for a new building, the 
tost-benefit analysis of a particular model of 
personnel use and on and on. 

1 he above leap from the nature of source data 
to the various outcomes of information manage- 
ment is nol an exaggeration, just a simplification 
ol the complex intervening tasks of function 
oriented systems documentation and related 
programing. Among these are the idinlificjtion 
and development of hardware configuration pro- 
viding nol only computer processing bul on-line 
remote capabilities of input and interrogation 
as well 

Ihe functions served by the computer and 
the bask nature of that service arc determined 
hv the cap* ily of Ihe on-site hardware and its 
accompany ing software. Very often Ihe soft- 
ware presents a real probUm. l ew educational 
institutKHis can afford ihe tCihnologkal skills 
of the software analyst and the skilled pro- 
gramed especially when these costs arc added 
to the eosi of leasing or purchasing the hard* arc 
component and providing tbc array of tech- 
nicians required for operation. However, a well 
engineerexi and flexible hardware configuration 
can economically handle the software variants, 
and multipk itistitulron utilization maximizes 
Ihe economical use of the hardware's capacity . 
subsequently maximizing cost benefits that can 
accrue to the user. 

A computer-based management system of the 
scope profited by t AIRI l /Bt SI would require 
tcihnkal skills and hardware Installation whose 
initial development costs and subsequent main- 
tenance costs would be peotiibitto for most. 
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if not all, educational institutions. Using the 
computer utility service concept minimizes the 
hardware cost and provides a basic system 
documentation upon which individual users can 
build, maintain and extend their own variations 
for only a portion of the initial and usually 
considerable developmental costs. 

An attempt should be made to avoid basing 
all educational decisions on only economic con- 
siderations. Political factors, communication 



problems, individual and group value structures, 
and local community economics are just a few- 
of the additional considerations. Furthermore, 
the utility must be capable of changing itself 
(an adaptive control system) based on new 
information or breakthroughs in disciplines re- 
lated to education. 

Milton C. Hitlcry is consulting coordinator 
for Biomedical Computer Services Inc . 3bQ 
Hamm Building, Sant Paul, Minnextfta 5SI02, 



Programing for Data Recording 



Robert 0. Ptckfd 



A device for collecting data does not guaran- 
tee useful data. If, as is the case with UMREL’s 
PPDF, the device is used by teachers, aides, and 
elementary students seven hours every day, five 
day* a week, effective instruction in the use of 
the PPDF becomes critical for insuring the 
validity and reliability of the data. 

Instead of more common methods like fee- 
Perspective 



lures, demonstrations, or handbooks, UMREL 
chose a Mathetics model for generating an 
instructional module for teachers and aides. 
Among the steps included in this instructional 
model are these four; I) perspective, 2) discrim- 
ination, 3) sequencing, and 4) transfer, as is 
demonstrated by the following segments from 
the programed manual for using the PPDF which 
was designed foj aides. 



Overv iew and knowled ge of c onsequences in using the PPDF corre ctly aie provided. 
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CJrtM loot « Mchof tfrfSIX STEPS: 

<$> ERRORS: bow many problem! done incorrecthr. or not don* etefl. 

(2) RETAXIS: bow many timer the student went back to correct enrwer* 

© EVALUATION ENO TIME: the clock time when row hoi* correcting Ibe fcudent’t *«xk. 

<J) LAST RETAKE END TIME the clock time when *e rtudent return* from e rttike end be* 100% 

correct 

(§) RE CHOICE: decode rvmbwofd* fteinfort Inf Event be t*>oom. 

<D RE ENO TtME : ihe time when you mt t#rr the student out of the Rl eree end beck to bit desk 
♦or another microtark . 

When you correct f paper with a rtudent and record bir performance, YOU ARE REALLY SUNG A 
TEACHER, because you ire - 

a fWnf Mm CREDIT for CORRECT leamin*. 
b hoping Mw RECOGNIZE and AVOID ERRORS, 

e recording information that R c^rka* to hh PROGRESS 

So you can tee Now Proponent rlHto EVALUATE AND RECORD CARET ULLY. 




Discrimination 

IVk'ciuimU- vK il I n ;inJ tlic component foj recording Jjla urc established and - treii£llH’iiei] by 
first demanding the correct re^poiwv then rcijiiirin^ a prompted response hy the learner. 




GOOD WORK* Easy, isn't it* Let s move on to the next step. 

After you have corrected the worksheet, marked No. of Errors and No. of Retakes, then enter the student's 
E VALUATION END TIME horn 



your watch or table ckxk 



on the student's Data Form: 
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Note*; 

at T here are separate columns for hours 
and for minutes. 

b) You Ml in one (and only one) circle 
»n each eo*um 
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Now try tM one yourself 

&*fiy corner f o you with her wo*i sheet and data form 
tor her evahiat»on. 

After you fmHh correcting her wOrktf>e€t and entered 
errors and tttakes. your clock says 



so you mark 



> 










Sequencing 

Component responses arc integrated in the correct sequence, again by demonstrating and prompting 
t his se quence. 

T ake a minute to practice numbering the foliowing steps in the order in which you would do them. 

Presume you have just corrected Mary's work end she has no errors. 

a. record the number of the RE she chooses. 

b. "What RE did you choose?" 

c. "Good work, Mary. Now you can go play with day/' 

_____ d, look at your clock and record Evaluation End Time. 

e. write the total time on the PROF in the right margin under RE End Time. 

_ f add 5 minutes to the present dock time. 

check your answers ^ 



Transfer 



Transfer of scqucrKcd components to the real demands of the classroom arc maximized through 
graduated levels of simulatfOn. This segment shows the final release which typically follows demon* 
strating and prompting frames. 



let's take one last quick review over the whole process: 

Record the following events in the panel below. (Presume the students are not entering any of their 
own data ) 

IPI Reading, level E, post test, page 1, problems l£30. 

You Judge that this student will find this work medium difficult. 

Oate: Oct.?. Student begins working on dirt mictotadt at 10: IS. 

Recess occurs from K? 30 to 10 .46. 

Student finishes his work at 10 66. he decides the microtask was "not too easy, not too hard/* 
Evaluation, completed at 1 1 00, reveals he made 3 errors. 

Student returns from reworking the errors, is evaluated, and stiR has 1 error (time 1 1 06). 

Student returns with the error corrected (time 1111) and chooses RE No. ?. 
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Information Search and Recording System 

Judith P» Fitch, William M. Ammcntorp, and Marvin F. Daley 



The Information Search and Recording Sys- 
tem (ISRS) is designed to acquire, classify, 
and store information relevant to systems en- 
gineering in education. An outgrowth of this 
function is the organization of stored informa- 
tion into annotated bibliographies. ISRS hold- 
ings include books, journals, reports, papers, 
pamphlets, reading review entries (abstracts of 
literature searches), ERtC microfiche materi- 
als and other non-print media. Reporting 
procedures and management information wilt 
be accessed to ISRS this year. 

ISRS was developed for the particular needs 
of UMRfc t researchers, tts specialized functions 
are accomplished by several sub-systems: 

Address system. All materials accessed lo 
ISRS are addressed by a subject classification 
scheme {term framework) tailored to Labo- 
ratory needs. The term framework reflects the 
program conceptualization and leads its users 
to think in terms of its categorizations, thus 
helping to foster similar viewpoints among the 
Laboratory staff. Procedures for indexing by 
the term framework and for storing manage- 
ment information, sources of information and 
suppoei. and reporting methods will t- devised 
and implemented this year. 

Reprint request system ISRS orders re- 
prints of papers and ankles at the request of 
UMREL researchers. This enables staff members 
to qukkfy obtain reprints of articles and papers 
and provides a method of continuously updating 
ISRS storage. 

Reading eerkw entry system. This system 
provides a standard method of abstracting, re- 
cording, indexing, and storing results of litera- 
ture searches. Weekly lists of reading review 
entries are sent to staff members, enabling them 
lo stay abreast of current research by reading 
abstracts of materials, while keeping informed 
about what other staff members are reading. 



All staff members are encouraged lo read regu- 
larly and record information relevant to the 
Laboratory program; experimental research ma- 
terials art emphasized. 

tSRS training procedures. Staff members 
were trained in use of the term framework, read- 
ing review entries, and ERIC microfiche, in- 
dexes, and reader-printer in programed 30- 
minute training sessions. New stiff members 
are trained individually in the use of total ISRS 
in programed 60-minute sessions. Trainees art 
expected lo perform specified behavioral out- 
comes at l Off* criterion level. ISRS support 
staff is trained through use of an operating 
manual and flow chart of daily activities; these 
will be programed in the near future. 

Literature search system. Annotated bibliog- 
raphies on subjects relevant to systems en- 
gineering in education are frequently prepared 
and updated by ISRS. ISRS also offers a 
broad and continuously updated information 
storage lo all UMREL literature searchers. ISRS 
storage is expanded by interlibrary loan proce- 
dures for all libraries in the Twin Cities area, in- 
chiding arrangements for pickup and return of 
books. Flans for the future include refining of 
literature search procedures, programing these 
procedures into flow charts, developing proce- 
dures for feasibility studies of literature searches 
by individual staff members, and devising a 
method for ISRS to assist and monitor searches. 

Current twreness system All incoming 
publications art scanned for materials of partic- 
ular interest to user* These materials are routed 
lo individuals or called to Ihe attention of the 
entire staff by a current awareness list. Entries 
on this list art grouped by subject using the term 
framework, and some are annotated. 

Through these sub-systems. ISRS provides for 
storage and retrieval of Information whkh sup- 
ports and H generated by program activities. 
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When reporting procedures and management in- 
formation are completely incorporated into 
ISRS, installation of automatic retrieval equip- 
ment will be considered. Contact has already 
been made with several suppliers, but present in- 
formation needs do not require such equipment 
However* because UMREL saw this as a likely 
possibility, the system procedures and conceptu- 
al base are compatible with automatic devices. 



1SRS is ar. unusual effort in the field of educa- 
tional research because it is specifically tailored 
to a particular program’s information needs. 
The ISRS model is adaptable to other research 
and development organizations with different 
program needs; a detailed explanation of devel- 
opment of the system is available from the 

Laboratory* 
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ERIC: A Component of the Information Search 
and Recording System 



Judith P. Filch 

UMREL’s Information Seatch and Recording 
System (ISRS) is an attempt to provide efficient 
information retrieval tailored specifically lo its 
organizational, information storage* and pro- 
gram objectives. No national information net- 
work can fulfil! this function. An information 
system which attempts to answer the needs of 
all people in the field of education (e g., Educa- 
tional Resources Information Center |ERIC|) 
cannot provide a common language system of 
precise terms targeted to research staff of a 
particular organization. Even educational net- 
works of a more limited scope (e g , Science 
Information Exchange [behavioral sciences). 
ERIC Clearinghouse on Educational Media and 
Technology) do not use language systems pre- 
cise enough lo meet all the needs of the Labo- 
ratory s developmental research 

However, ERIC and other information net- 
works provide excellent support lor ISRS when 
integrated into the system as a component of 
the information storage. ISRS maintains close 
contact with the ERIC clearinghouses and fre- 
quently obtains newsletters ard papers from 
them. UMREL has a complete collection of 
ERIC materials which is available to staff 
members without time-usage reslrk lions and to 
the public for limited time-usage in house. ISRS 
provides a standard abstracting and recording 
method by which researchers can draw Informa- 
tion from ERIC and store it for future retrieval. 



All terms in the ISRS subject classification 
scheme (Term Framework) can be found in the 
ERIC Thesaurus, staff members accustomed to 
the language system of the Laboratory arc able 
to broaden the scope of their literature searches 
by referral from one term lo another in the 
Thesaurus In this way ERIC provides a broad 
base of information, which can be entered by 
using the Thesaurus, in addition lo other infor- 
mation stored and indexed by the common lan- 
guage system of ISRS. 

UMREL's research staff is trained to use 
ERIC in a 15-minute programed session. The 
major portions of the ERIC indexes are ex- 
plained, and use of the microfiche files and 
reader-printer is demonstrated. Trainees arc 
then given assignments of documents to be 
located in the indexes and on microfiche. The 
intended behavioral outcome is to produce a 
print-out copy of the microfiche abstract for 
the assigned document A one month evalua- 
tion following training of the entire staff showed 
that the ERIC collection had been used by over 
onc-hjlf of the staff. 

A trairdng program In the form of a detailed 
list of procedure* is provided for people from 
outside tire Laboratory. A filmstrip-record 
presentation may also be provided, if usage fre- 
quency warrants it. The public is advised to 
make telephone arrangements in advance of in- 
tended ERIC usage. 



